Information-theoretic vs. thermodynamic entropy production 
in autonomous sensory networks 
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For sensory networks, we determine the rate with which they acquire information about the 
changing external conditions. Comparing this rate with the thermodynamic entropy production that 
quantifies the cost of maintaining the network, we find that there is no universal bound restricting 
the rate of obtaining information to be less than this thermodynamic cost. These results obtained 
within a general bipartite model consisting of a stochastically changing environment that affects 
the instantaneous transition rates within the system are illustrated with a simple four-states model 
motivated by cellular sensing. On the technical level, we obtain an upper bound on the rate of 
mutual information analytically and calculate this rate with a numerical method that estimates the 
entropy of a time-series generated with a simulation. 
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Acquiring and processing information about the in- 
stantaneous state of the environment is a prerequisite 
for survival for any living system. Sensory and signal 
transducting networks have evolved to achieve this task 
under a variety of external conditions as, e.g., the work on 
bacteria like Escherichia coli has demonstrated so beauti- 
fully P, 0] . Maintaining any biochemical network, how- 
ever, has a metabolic cost associated with its inherent 
non-equilibrium nature. This fact prompts the question 
whether there is a relation between the performance of 
the network and its free energy consumption. For sensory 
adaptation in E. coli, such a trade-off between adaptation 
speed and accuracy, and the energy dissipation rate has 
recently been found in a theoretical model and confirmed 
with experimental data Q. 

From a more information-theoretic perspective, the 
question alluded to above can be formulated more gen- 
erally as to whether there is any quantitative relation 
between the rate with which such a network acquires in- 
formation about the ever changing environmental condi- 
tions and the rate of entropy production associated with 
the functioning of the network. The universal concept for 
quantifying one side of this balance is mutual informa- 
tion, or, more precisely, the rate of mutual information, 
fn the context of sensing, this rate has been introduced in 
[3] , where it was explored for the special case of Gaussian 
input and output signals and various network motifs. Im- 
portantly, as pointed out in [4] , because it takes temporal 
correlations into account the rate of mutual information 
is different from the static mutual information, which has 
been the subject of several recent investigations in genetic 
regulatory networks [||. On the other hand, calculating 
the rate of mutual information without the assumption 
of Gaussian statistics represents a main challenge. 

In this paper, we obtain an upper bound on the rate 
of mutual information for a general bipartite model con- 
sisting of an environment that switches stochastically be- 
tween an arbitrary number of states and a network for 



which the internal transition rates depend on the instan- 
taneous state of the environment. This set-up has the 
advantage that the total system is in a non-equilibrium 
steady state generated by a Markovian dynamics which 
facilitates the analysis. Still, since the internal process 
is non-Markovian, deriving the expression for this bound 
as done below becomes non-trivial. Moreover, in order 
to calculate the precise value of the rate of mutual in- 
formation we apply a numerical method that estimates 
the entropy rate of a single time-series produced from 
a numerical simulation [6-8]. For evaluating the second 
side of the balance introduced above, we need the rate 
of (thermodynamic) entropy production, as it has been 
derived for any network with given transition rates some 
time ago 0] and revitalized in the context of stochastic 
thermodynamics as reviewed in 10]. 

Significant progress in relating information-theoretic 
concepts to thermodynamic ones has recently been 
achieved in the context of feedback-driven systems [lll - 
flil ]. For these systems, the amount of mutual infor- 
mation between system and controller enters the cor- 
responding thermodynamic expressions on the level of 
generalized fluctuation theorems and second-law like in- 
equalities. In particular, the net-power output of such 
systems can not exceed the rate of mutual information 
acquired. The single cell, however, is an autonomous sys- 
tem for which a separation into an act of measurement 
and subsequent feedback control does not come naturally. 
Whether despite this fundamental difference between a 
feedback-driven system and an autonomous one, an anal- 
ogous constraint on a putative efficiency relating the rate 
of acquiring information with the thermodynamic cost of 
maintaining the sensory network exists will be explored 
here. 

In order to introduce this rate of mutual information 
between external and internal processes and compare it 
to the entropy production, we first consider the minimal- 
istic model shown in Fig. Q] The environment is sup- 
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FIG. 1: Network and transition rates of a simple model of an 
internal process Y coupled to an external one X. 

posed to switch stochastically with rate 7 between two 
possible states Xa and X B . Within the system, there is 
an internal degree of freedom, which exists also in two 
different states that are correlated with the environment 
state. Specifically, if the external state is Xa (Xb) and 
the internal state is in the "false" state Yb (Xa), the in- 
ternal state changes to Ya (Yb) with a rate k+. We also 
allow for a (small) rate fc_ inducing "false" transitions. 
Later we will consider a more realistic model for bacte- 
rial chemotaxis, where the external states correspond to 
the state of a receptor sitting on the membrane, while 
the internal states correspond to some internal protein 
that can be transformed to an active form with transi- 
tion rates that depend on the state of the receptor. 

As we will show below in equation (|13|) using a gen- 
eral framework, the rate 1 at which the internal system 
acquires information about the time-dependent state of 
the environment is bounded from above by 



/(fc+,fc_) + /(fc_,fc+), 



(1) 

and in 



where f(r 11) = x( ~y+^ In x ( x +v+ 2 i) p or u 

the limit k + ^> 7, the rate of mutual information can be 
understood as follows. The uncertainty about the exter- 
nal time-series X(t) still left after recording the internal 
time-series Y(t) is basically the specific time lapse be- 
tween a change in the external conditions and the change 
of the internal state, since for k- = an internal jump 
takes place only after an external jump. Thus the system 
can localize the change in the external conditions within 
a time window of width l/fc + . Encoding the length of in- 
tervals between switching events on a scale l/fc+ requires 
a number of order fc+/7, which carries ln(fc + /7) units of 
information (measured throughout this paper using nat- 
ural logarithms) . Since these switching events take place 
with a rate 7, the rate of mutual information, for fc_ = 



and fc+ 3> 7, is 1 — y]n- 



Therefore, in this limit, 



the upper bound {TJ gives the correct value of the rate 
of mutual information. 

The dissipation rate a associated with this network 
follows from the standard expression for Markovian pro- 
cesses, recalled in equation (1161) below, which gives 




FIG. 2: The rate of mutual information Z, estimated with 
the numerical method explained in the text, the upper bound 



and the thermodynamic entropy production a as a func- 



r (*0 

tion of k- for fc+ = 25 and 7 = 1. Here and in the following 
figures the common unit of time is arbitrary and the error in 
the numerics is less than the size of the symbols. 



where g(x,y) = ^ n y ' thermodynamic en- 

tropy production fulfills a > and is zero only if detailed 
balance is fulfilled (fc_ = 

Whereas the rate of mutual information is finite at 
fc_ = 0, the entropy production diverges as k- — > 
0. Therefore, when the system is far from equilibrium 
(fc_ <S fc + ) the dissipation rate is larger than the mu- 
tual information rate. On the other hand, at equilibrium 
(fc_ = both quantities are zero: there is no dissi- 
pation and the internal and external processes are un- 
corrected. Note that in this case also the internal pro- 
cess becomes Markovian. In Fig. [2] we compare the rate 
of mutual information obtained from numerical simula- 
tions, as explained below, with the thermodynamic en- 
tropy production. There is a value of fc_ , which depends 
on fc + and 7, beyond which the mutual information rate 
becomes larger than the thermodynamic entropy produc- 
tion. Thus, as our first main result, we have found that 
in the most simple conceivable model the rate of mutual 
information is not bounded by the dissipation rate. 

We now address the problem of calculating the upper 
bound within a general bipartite model. It will be con- 
venient to first treat time as discrete with a spacing r. 
We denote the external states by a, j3 and their transi- 



tion probabilities by W 



a/3 — 



t, where the transition 



g{k+, k -) +9(k-,k + ), 



(2) 



is from a to /3. The transition probability from the inter- 
nal state i to the internal state j, given that the external 
state is a, is W°j = wf^T. Hence, the transition proba- 
bilities of the internal transitions depend on the instan- 
taneous external state. States of the total system are 
thus determined by the pair (a, i), with the transition 
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probabilities of this full Markov process given by 
w a ^r if i — j and a ^ j3 



II 



a/3 _ 



w°jT if i ^ j and a — j3 (3) 
if i ^ j and a ^ (3 



A stochastic trajectory with N jumps is denoted by 
{{X u where {X t }?J ({Y t }fL T ) represents the ex- 

ternal (internal) process. The information-theoretic en- 
tropy rate of the full process measures how much the 
entropy of the trajectory grows with N. In the limit 
N — ^ oo, it is given by [17[ 

Hx,y = -\ £ IfWfhiWf, (4) 

where P" denotes the stationary state probability distri- 
bution and, from equation ([3]), the diagonal terms take 
the form W$ a = 1 — J2p^ a wat ?T '~J2j^i w ij T - Moreover, 
since the external transitions are independent of the in- 
ternal degrees of freedom, the external process {X t }^J Q 
is also Markovian, which implies for its entropy rate 



H x = — y P a W afi \nW af3 , 



a/3 



(5) 



where P a = J2i P? and W aa = 1 - J2^ a W ^ T - Here ; 
we are interested in calculating the rate of mutual infor- 
mation defined as 11711 
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X,Y- 



(6) 



The still missing piece for evaluating this expression is 
the entropy rate of the internal process Hy , which is not 
known because Y t is in general non-Markovian. However, 
this quantity is bounded from above and from below by 
the relation [l7| 

H(Y n+1 \Y n ,...,Y 1 ,X 1 )<H Y <H{Y n+1 \Y n ,...,Y x ), 

(7) 

which involves conditional entropies. Here, we are consid- 
ering a finite sequence of n jumps of the internal process 
starting with the stationary state probability distribu- 
tion. These bounds become better as n increases and for 
71 — y oo both converge to the same value which is the 
entropy rate Hy [13] • The first upper bound is given by 

H(Y 2 \Y 1 )=-^P(Y 1 )^POr 2 \Y 1 )\nP{Y 2 \Y 1 ). (8) 

Vi Y 2 

Using the transition rates ((3]) we have 

W) - Wi) — - — Pi — ' (9) 

where we substituted X% — >■ a, Y\ — > i, and Y 2 —> j- 
With this relation it is easy to obtain 

H(Y 2 \ Yl ) = -J2 P ?H (< ln E ' P ^ T ~ <) 

i,a j=£i \ / 

+O(rX.10) 




FIG. 3: The lower and upper bounds on the mutual informa- 
tion rate and the numerical simulation result as a function of 
r for fc_ = 5, k+ = 25, and 7 = 1. The simulations were done 
for a time series with N = 10 10 . 



Moreover, from (|4]) and ([5]), we get 

h x - hx.y = p ? E «■ ln < r - <) + °( T )- 

i,a j^i 

(11) 

Therefore, the first upper bound for the rate of mutual 
information, as obtained from ©, (fTTJj) . and (fTTj) . reads 



i x t ;Y ) = Y, p ?Y,<^=+°(Ti (12) 

i,a jjti 



III; 



where «jq = P(/3\i)w?j is the mean internal transi- 
tion rate and P(/3\i) = Pf /Pi is the probability of being 
in the external state j3 given that the internal state is 
i. More generally, we find that up to O(rlnr) all upper 
bounds with finite n are given by this expression, mean- 
ing that I%$> = if <j ln = + 0(t In r). As 



for the lower bounds, we find that I 



(l,n) 



l xy ~ O(rlnr) for 
all n. Therefore, we conclude that the rate of mutual in- 
formation in the continuous time limit is bounded from 
above by 



x^=5>f£<m=- 



w, 



(13) 



We note that all the bare entropy rates diverge as lnr 
for t — y and, therefore, cannot be defined in this limit 
[l8L [l9j |. However, the rate of mutual information is a 
well behaved quantity in this limit with no logarithmic 
divergences. 

Let us now explain the numerical method we use to 
estimate the entropy rate Hy of the non-Markovian 
time series {Y t }^J Q . The random matrix T(Yt,Yt— i), 
is defined as T{Y t ,Yt-i)x t ,x t - l = P[Y t , X t \Y t . 1} AVi], 
where P[Y t , X t \Y t ~i, X t ~i] is a conditional probability. If 
the external states take the values X t = 1, . . . , CI, then T 
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is a f2 x fi matrix, where the internal variables (Y t ,Y t -i 
make the matrix random. It is simple to show that [i" 



P[{YtKJ ] = VT(Y Nl Y N ^) . . . T(Xi,Yo)V (14) 

where -P[{^t}t=o] is the probability of the time series, V 
is a vector with all components equal to one and Vq is 
a vector with components P(Yq, Xq), for Xq — 1, . . . , O. 
From this relation, it is then possible to show that given 
a typical long time series {ytlSn one can estimate the 
entropy rate Hy by the formula 



1 N 



uVt-ij 



(15) 



where ||-|| is any matrix norm. Therefore, following Ref. 
Q , we can calculate Hy numerically by generating an in- 
ternal time-series with a simulation and calculating the 
above product by normalizing it after a certain number of 
steps (kee ping track of the normalization factors) , as ex- 
plained in [20|. In Fig. [3J we plot upper and lower bounds 
on the mutual information rate, obtained from ([7]), and 
the numerical simulation result. For small r, the numer- 
ically obtained rate of mutual information shows linear 
behavior, which we extrapolate to r — ► to estimate the 
rate of mutual information in the continuous time limit. 

The other central physical observable we consider here 
is the thermodynamic entropy production [^, [Tol 21 



which for the present class of Markov processes reads 



a,/3 



v a/3 In ■ 



■7" 



w ij 



(16) 



where the first term on the right hand side is due to the 
external transitions and the second is the contribution 
from internal transitions. 

We finally use this framework to analyze a thermody- 
namically consistent minimal four-states model for bac- 
terial chemotaxis in the spirit of the work of Berg and 
Purcell [H (see also 22-25]). The external states are 
related to a receptor that can be either bound (on) by 
a ligand or empty (off). The transition from bound to 
empty happens at a rate fc D g, whereas the binding rate 
fcon is proportional to the concentration of ligands in the 
external environment. The internal state is associated 
with a downstream protein that can be in an inactive 
(Y) or, due to phosphorylation, in an active state Y*. 
For simplicity, we are assuming a two states internal sys- 
tem corresponding to one downstream protein. In reality, 
the number of downstream proteins is much larger than 
one [25I ] . however, this simplification is not harmful for 
the qualitative comparison between the mutual informa- 
tion rate and thermodynamic entropy production. 

The crucial coupling to the instantaneous state of the 
environment, here encoded by the state of the receptor, 
arises from the fact that the bound receptor speeds up 
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FIG. 4: The entropy production rate a, the upper bound T~ u ' 
and the numerically determined rate of mutual information 
I as a function of a for the thermodynamically consistent 
model shown in the inset. The other parameters are set to 
fc on = fcoft = 1, K- = 1/10, k+ = 4/10, lo- = 1/10, and 
uj+ = 6/10. 



phosphorylation, which happens at a rate k + , by a fac- 
tor a > 1 compared to the action of an empty receptor. 
Dephosphorylation occurs at rate w+, which leads to the 
following internal ATP consumption cycle 

Y + ATP ^=t^Y* + ADP ^Y + ADP + P h (17) 

(a)«_ uj- 

where the factor a arises only if the receptor is in the 
bound state. The full network of transitions is shown 
in Fig. [4] Thermodynamic consistency requires, first, 
that we also allow for the reverse transitions of phos- 
phorylation and dephosphorylation with non-zero rates 
(a)/t_ and cj_, respectively. Second, it imposes a rela- 
tion between the free energy associated with the ATP 
hydrolysis A/i and the kinetic rates, which reads A/i = 
kptT\n where fcn is Boltzmann's constant and T 

the temperature [9|, [l0| . 

In Fig. [4j we compare the rate of mutual information, 
obtained with the numerical simulation, with the rate of 
free energy consumption a as a function of the enzymatic 
enhancement a. For a — 1, the internal state is decorre- 
latcd from the external one, leading to 1 = 0. However, 
if A/i ^ 0, the internal network still consumes free en- 
ergy. With increasing a the rate of mutual information 
increases, eventually becoming larger than the rate of free 
energy consumption. Thus, this thermodynamically fully 
consistent model confirms what we have found previously 
in the simple model: in such autonomous networks the 
rate of mutual information is not bounded by the free 
energy consumption required to maintain the network. 

Why is the situation for an autonomous network ap- 
parently so different from what has been found for 
feedback-driven models? In the latter, information ac- 
quired through a measurement is used to extract net 
work from a thermal bath. The amount of net work 
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is limited by the information. Here, for the sensory 
network, we have investigated a complementary issue, 
namely whether the amount of information is limited by 
the chemical work, or free energy consumption, required 
to maintain the network. How this information is now 
used in a second step for an action that possibly per- 
forms work on some other element is an interesting but 
quite different question. As an important aside, we note 
that for an autonomous network the whole issue of writ- 
ing the information into a memory whose erasure will 
require free energy [2ol 27 | is irrelevant as the erasure 



process is trivially included in the reaction scheme. 

Clearly, these concluding remarks touch on deep is- 
sues concerning a future theory comparing comprehen- 
sively autonomous with feedback-driven systems which 
is a distinction that may become blurred in the micro 
world. On a more specific level, our study should now 
be refined by incorporating further elements of a more 
elaborate model of a sensory network, i.e., including sev- 
eral receptors, several proteins, allowing for adaptation 
and alike. The quantitative balance between information 
rate and entropy production will depend on such details, 
and thus, e.g., optimization of the "efficiency" will be- 
come an interesting issue. Searching for a hard universal 
thermodynamic bound for it, however, should be futile, 
as our simple model shows. Finally, an exact calcula- 
tion of the rate of mutual information remains an open 
mathematical challenge. 

Support by the ESF though the network EPSD is 
gratefully acknowledged. 
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